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Abstract 


A novel approach for lossless as well as lossy compression of monochrome images using 
partitioning of Boolean functions by Walsh-Hadamard Transform and by minimizing Boolean 
functions in Reed Muller representation form is presented The image is split into bit 
planes, and the bit-planes are divided into blocks Each block is transformed into a Boolean 
switching function, treating the pixel value as output of the function In Walsh-Hadamard 
case compression is performed by mapping the Boolean function to a prototype Boolean 
function and coding the operations required for it using adaptive block coding method 
by treating the operations as blocks In Reed-Muller case, compression is achieved by 
minimizing the switching function by selecting the appropriate basis and by coding the 
coefficients and the basis Our technique of lossless compression involves linear prediction 
or indexing method as a preprocessing step, and has compression ratio greater than block 
coding lossless compression technique Lossless compression technique has been extended 
to text files also Our lossy compression technique involves reducing the number of bit 
planes as a preprocessing step, which incurs minimal loss in the information of the image 
The bit planes that remain after preprocessing are compressed by using lossless compression 
technique Qualitatively one cannot distinguish between the original image and the lossy 
image and the value of the mean square error is kept low The compression scheme is slower 
while the decompression is comparable to that of block coding 
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Definitions 


1 A Boolean switching function F is a mapping F B'' —r B ivhere B = {0 1} 

2 In the truth table of a switching function ot X variables there are 2'’ lovs Each 
row represents a input vector called mm term 

3 For a switching function the OX-set is the set of Reed-Muller coefficients ha\ing 
value 1 and the OFF-set having value 0 

4 For Walsh-Hadamard transform, we define switching function F is a mapping 
F B^ B where B = {1,-1} 

5 The performance of a lossless data compression algorithm is asserted by the pa- 
rameters compression ratio and compression time \\ e define compression ratio as 

total input bytes - total output bytes ^ jqqc^ 
total input bytes 

6 bit-plane Consider an image, where each pixel is represented by k-bits By 
selecting a single bit from the same position in the binary representation of each 
pixel, k-bmaxy images called bit planes can be generated 

7 Uncomplimented literal is represented as x. 

Complimented hteral is represented as J, 

x' represents either complimented or uncomplimented literal 


X 



Chapter 1 


Introduction 


Compression of Image data is important from the point of view of storage and trans- 
mission, as it helps in saving storage space and transmission time Lossless compres- 
sion techniques permit the recovery of an exact copy of original image where as lossy 
techniques permit only an approximation to be recovered Conventional lossless com- 
pression techniques employ de-correlation techniques such as DPCM or Hierarchical 
Interpolation followed by a coding scheme such as Huffman coding or arithmetic cod- 
ing In this thesis we propose two different approaches to code sub blocks of an image 
bit-plane 

1 By converting each Boolean function into its prototype Boolean function by Walsh 
Hadamard Transform and coding the operations required for it 

2 Minimizing the Boolean function by Reed- Muller representation and coding the 
coefficients 

In lossless compression the image file after being preprocessed is split into bit-planes 
Each bit plane is a binary image which is divided into fixed blocks, and each block is 
converted into a Boolean function The functions are then converted into its proto- 
type Boolean function by Walsh- Hadamard Transform The operations required for 
It are coded to obtain the compressed data In Reed-Mulier Representation, Boolean 
functions which are converted from blocks are minimized by representing them in the 
appropriate basis functions The minimized function which represents coefficients hav- 
ing either only ones or only zeros are coded to obtain the compression 
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In lossy compression we leduce the number of bit levels in the original image to 
less than or equal to 32 by appKing center of mass technique The image containing 
at most 32 gray levels wiU be recoded by mapping the gray values to a 5 bit gray code, 
thus reducing the number of bit planes from S to 5 The mapping function leads to 
a fixed over head of only 96 bits These five bit planes will be processed m rhe same 
manner as we do for the lossless compression scheme 

1.1 Compression schemes 

In this section we are discussing the different compression schemes 

• In Block coding, image is divided into bit planes and bit planes are divided into 
blocks, the all O(white) and all l(black) blocks are represented by 2-bit code, 
where as mixed type block is stored directly after a 2-bit code [6] Results of 
this block coding on images is shown m results chapter Compression of images 
can be done with the combination of block coding and arithmetic coding [7] 
with compressed block are represented by a two bit header and the coded bits, 
Uncompressed block is represented by a two bit header and the original bits 

• JPEG employees a de-correlation scheme based on DPC!M(several predictors are 
provided) followed by adaptive Huffman coding or arithmetic coding The lossy 
JPEG processes are based on the Discrete Cosine Transform(DCT) and entropy 
coding of the quantized DCT coefficients based on adaptive Huffman or arithmetic 
coding The DCT turns an array of intensity data into an array of frequency data 
that tells how fast the intensity \ ary Quantization sets the precision to which each 
of the values resulting from the DCT is stored JPEG uses linear quantization 
which means, that each of the DCT values are divided by a quantization factor and 
rounded to an integer to get the value that will be stored These quantized values 
are coded by adaptive Huffman or anthmetic coding Decompression reverses the 
above steps 

• In run length coding [13], a series of repeated values(pixel values) is replaced 
by a single value and a count. For example a series of values like abbbbbbbc- 
cddddeeddd can be replaced by coding the count of consecutive letters Images 
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with large areas of constant shade, this scheme gives higher compression Run 
length coding is used in many bit map file formatsi TIFF | 

• Huffman coding is a common scheme for compression It v.orLs by substituting 
more eflacient codes for data In this scheme binary code is assigned to to each 
unique value, with the codes varying in length The‘=e assignments are stored in 
a conversion table which is sent to the decod.ng software before the codes are 
sent For file compression compression ratios are order of S 1 can be achieved 
Huffman coding is poor choice for files with long runs ot single values which can 
be better compressed using run-length or other codings Huffman coding also 
needs accurate statistics, on how frequently each value occurs in the original file 
Huffman coding is done in two passes In the first pass, the statistical model is 
created, in the second the data are encoded As a lesult, and because variable- 
length codes require a lot of processing to decode, Huffman compression and 
decompression is a relatively slow process 

• In arithmetic compression, uses shorter codes for frequently occurring things and 

longer codes for infrequently occurring things [11] Arithmetic compression comes 
close to theoretical limits for compressmn This involves mapping every different 
sequence to a region on an imaginary line between 0 and 1 That region is 
represented as a binary fraction of variable precision(number of bits) Therefore 
less common data require a higher precision(more bits) Arithmetic compression 
can reduce file size dramatically, depending on the source and the accuracy of the 
statistical model used Compressions of 100 1 may be achieved 

• Lossless data compression is performed m computers by using the following meth- 
ods [4] Some of the commands which are used in the computers, and their in- 
ternal operation is described below The command compress, which is used in 
our computer systems uses an adaptive Lempel-Ziv coding [8] This coding will 
be done by replacing 9 bit codes (257 and up) to common substrings in the file 
When code 512 is reached, the algorithm switches to 10 bit codes and contmuos 
to use more bits until the limit specified by the user or by default 16 After 
max-bits limits is reached, compress periodically checks the compression ratio If 


it IS increasing, compress continues to use the ng code dictionary If it is 
decreasing compress discards the table of strings and lebudds it from the scratch 
this allows the algorithm to adapt to the next block of hie 

The command pack uses Huffman coding on a byte by byte basis The amount 
of compression obtained depends upon the size of the input hie and the chaiacter 
frequency distribution 


1.2 Organization of thesis 

In chapter 2 we describe the methods which have been adopted to solve our problem In 
chapter 3 we describe the implementation of our lossless lossy algorithms In chapter 
4 we have given the results obtained for our algorithm In chapter 5 we give the 
conclusions and the future scope of work 



Chapter 2 


Mathematical Preliminaries 


In this chapter we discuss the two methods which have been adapted to solve our thesis 
problem Wahh-Hadamard transform has been used to classify Boolean functions, using 
five invariance operations We derive the effect of those five invanance operations on 
spectrum Reed-Muller expansion has been used to mininaize the Boolean function with 
appropriate polarity function 


2.1 Walsh Hadamard transform 

Basis functions for Walsh Hadamard transform [3] are 
iru(x) = (-l)<S-o '‘■"d 

where ic, and x, are binary representations of x, w 
w,x 6 0 to 2” — 1 w and x being, 


W = UJn-l2" ^ + U,’„_22" ^ + + H’O 

X = x„_i2" ^+x„_ 22" + xo 

Walsh- Hadamard transform of a n variable Boolean function f(xj is gi'ven by 

• S = W F 
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where, IE is 2" x 2" naatrix 

F IS 2" X 1 matrix whose elements aie real values 1 and -1 luth bindiy 0 mapped to 
1 and binary 1 to —1 

and 5 IS 2" X 1 spectral coefficient matrix < nx > is called inner product vrhich is equal 
to X where, w x are coloumn vectors Each \'aiid spectrum represents a Boolean 
function, and requires 2” x 2”"^ number of opeiations( additions or subtractions) to 
compute it for a n variable Boolean function Walsh-Hadamard matrices are orthogonal 
symmetric, and its inverse is identical to itself with multiphing factor ^ So that 

Walsh-Hadamard matrix for n = 3, is shown below 


1 

1 

1 

1 

1 

1 

1 

1 

0 

1 

-1 

1 

-1 

1 

-1 

1 

-1 

•To 

1 

1 

-1 

-1 

1 

1 

-1 

-1 

•Tl 

1 

-1 

-1 

1 

1 

-1 

-1 

1 

To W J "! 

1 

1 

1 

1 

-1 

-1 

-1 

-1 

X 2 

1 

-1 

1 

-1 

-1 

1 

-1 

1 

Co 5 X2 

1 

1 

-1 

-1 

-1 

-1 

1 

1 

•Tl 0 X 2 

1 

-1 

-1 

1 

1 

-1 

-1 

1 

Xo 0 Cl 0 X2 



By reading 1 as 0 and —1 as 1 in the hadamard matrix, row vectors may be seen to 
related to x, input variables over (0 2" — 1 ) as shown m the matrix above The resulting 
spectrum coefficients in S is equal to the number of occasions the min term value of 
the Boolean function agree with the corresponding Hadamard row \alues minus the 
number of times the two values disagree Representing S =< Sq.S^Sz, ,S' 2 '«-i > 
by < 5o, Fi, 52, 5 i2, 53,5i3, , 5 i 23 n > where S,j represents the correlation between 

the Boolean function and x, *3 Xj 

So being the zeroth order coefficient 

5, 1 = 1 to n the primary or first order coefficient, 

5,j ij = 12, 13 • - the second order coefficient, 

S,jjt ijk = 123, 124, 134 the third order coefficient, and so on 

The Walsh-Hadamard matrix W of the order 2" x 2" it can be decomposed and is 



equal to For n = 3, 

1 1 0 0 0 0 0 0 1 

0 0 1 1 0 0 0 0 

0 0 0 0 1 1 0 0 

0 0 0 0 0 0 1 1 

1 -1 0 0 0 0 0 0 1 

0 0 1 -1 0 0 0 0 

0 0 0 0 1 -1 0 0 

0 0 0 0 0 0 1 -1 

We used this matrix to find the spectrum of a binary function, by this the number of 
operations( additions or subtractions) will be reduced to n < 2" 

The properties of the spectral coefficients obtained for the Boolean functions 

1 The sum of all spectral coefficients of S of a fully defined Boolean function is 
equal to 2". 

2 The maximum value of a spectral coefficient of S is ±2", this occurs when f(x) is 

equal to any row of the Hadamard matrix or negative of it The range of each 
coefficient is -2", -2" +2, ,0, , 2" - 2. 2". 

3 When any of the spectrum coefiEcient is maximum valued, then all other coeffi- 
cients are zero 

4 When any input \ariable j, is redundant in the function, then the spectral coef- 
ficients having subscript i. will be zero valued 

2.2 Classification of Boolean functions 

The set of 2^" Boolean functions of less than or equal to n variables ( an be classified 
into equivalent classes as shown in figure 2 1 In each equivalent class all the functions 
can be realised using any Boolean function in that class [1][2] Classification of Boolean 
functions has two advantages 
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Figure 2 1 Classification of Boolean functions 

1 Testing and fault diagnosis procedures may be standardised for each classification 
entry as they have identical realization 

2 One prototype or standard Boolean function from each classification entry is used 
. to realize all other functions, from appropriate operations corresponding to the 

classification procedure 

In classifying the Boolean functions we do the following five basic operations 

1 (N) Negation of one or more input \anables x, 

2 (P) Permutation of two or more input variables x, 

3 (N) Negation of the output function f{x) 

4 Replacing one or more input variables by Exclusive-or of that variable and one 
or more other input variables 

5 Replacing function output by Exclusive-or of that function and one or more input 
variables 
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Boolean functions which are classified under the first three operations are called 
XPX equivalent functions 
for example 

fi{X) = X1X2 + r 2 r 3 

/2f A ) = Xi E2 + X2X3 
/3(A) = X1J3 -r X2X3 
MX) = X1X3 + X2X3 

functions fi(X) and /2(A'’) are related by the input peimntation ^ cz- f’lnct.ons 
fi{X) and /2(A) are related by the negation X2 Tt and the permutation T2 
and functions MX) and /4(A) are negation of each other MX) = f^iX), resulting 
these four functions fall into the same NPN classification 

One more algebraic classification called Self dual algebraic classification is much 
more compact than NPN eqmvalent classification The dual of any function f(X) is 
given by /^(A) = /(A), where bar in the parentheses indicates that all the input 
variables x, are complemented If the dual of any function is equal to the function 
it self then that function is called self dual function The property of a seif dual 
function M^{Xn) of n variable is, when it is decompossed into two functions about 
any variable x,, the two resulting n — 1 T-’anable functions will be duals of each other 
The function /'®^(A„+i) being a representative function for all the NPN equivalent 
functions obtained by decomposing f^^{X„+i) about each of its x, input variables, 1 
= 1 to n+1 Thus f^^{X„+i) is much more compact than NPN classification 

2.3 Spectral classification 

In this section we discuss the five basic operations in classifying Boolean functions of 
less than or equal to n variables in the transform domain. 

2.3.1 Effect of invariance operations on spectrum of Boolean 
functions 

We derive the effect of five mvciriance operations, which are mentioned above, to full 
set of 2" spectral coefficients 
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1 Interchange (permutation} of input variables c, and Vj 
Let f(x) be a Boolean function and Sf’.vj be me spectrum 
where x = ,xo) 

and w = {li'n-i . u'o) 

From the definition a Walsh-Hadamaid transform ot a Boolean function 
S(w) = Ef.;' 

Let S'(w) be the spectrum of a Boolean function f\g_ r) 

where £ is a n x n non singular matrix with elements from Z 2 and the additive 
operation is with respect to mod 2 From the definition of WHT 

5'(u>) = '^'/(£)(-l)^- (2 1) 

x=0 

where < w x> is called inner product and is equal to ic^x 
Let y = cr_ X, substituting this m the equation (2 1) we have 

S'{w) = (2 2) 

x=0 

consider the term < > , which is equal to 

it can be written as 


further it can be written as 


T -1 
IL !L V 


{g_ io)^y_ (2 3) 

(Here, we made use of matrix properties, {AB)^ = AF and — A where A 
aind B axe matrices ) 

substituting equation (2 3) in equation (2 2) we have 

(2 4 ) 

x=0 
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From the definition of WHT 


S'{ K I = S' a IL! 
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5 1 


For example the matrix shown below corresponds to a four variable Boolean 
function f(j: 3 , j: 2 . j:i, Jo) 


cr = 


110 0 
0 0 10 
0 10 0 
0 0 11 


The corresponding new input variables are ao is replaced by ro -r ri and ri 
are interchanged(permuted), Xs is replaced by X 2 -3 -fs 

By interchanging the input variables r, and Tj, i ^ J ? j € 1 to n, the resulting 
new spectrum from the original Boolean function spectrum can be obtained b> 
replacing the subscript i by subscript j and vice versa This requires the inter- 
change of 2”“^ pairs of spectral coefficients 


Sg S J 

■Sifc '’jfc 

S,kl ^ ^jkl 


Note that the coefficients so,Sk,s,j • remain unchanged 

2 Complementation of input variable x. 

Let S(w) be the spectrum of f( j„_i, ,j„ , Jq ) 

and S'(w) be the spectrum of f( j„_i,a’„_ 2 i , xo ) 

Now, from the definition of WHT, 

2”~1 

S(w) = ^ /(x)(-l)Sr=a (2 6) 

r=0 

and S / (w) IS given by 

2 "-! 

S'(w) = ^ , Ji, 

1=0 




(2.7) 
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Partitioniag the space 0 to 2" — 1 into two parts p and p wnere 
p £ 0 to 2” — 1 for all values of x, is equcd to zero 
p £ 0 to 2" — 1 for all lalues of r, is equal to one 
therefore equation (2 6) can be written as 

S(u’) = - X]/' '2 Si 

lep 

in equation (2 8) the term ( — can be written as i 
substituting this in ecpiation (2 Sj we have. 

S{il) = + (2 9) 

xEp xEp 

In the equation (2 9), r, is equal to 0 in the first term and is equal to 1 in the 
second term Therefore we have, 


5 ( 10 ) = (2 10 ) 

xEp xep 

Let y = 0001000 -p x where 1 is in I’th position, 

substituting this in equation(2 7) we have, 

S'iw) = (2 11 ) 

y=0 

Again dividing the space 0 to 2'* — 1 and following the same steps from equation 
(2 6) to (2 10) we ha\e. 


y€p 


-i)S 




Ljyj 


(- 1 ) 




+ E /(!')(- 

y^p 


-i)S 




2^j(_l) 


u-'.y. 


(2 12 ) 


In the first term in equation (2 12) y, is equal to 1 and for the second term y, is 
equal to 0 Substituting these values in equation(2 12) we have, 


S'{w) = (-!)"• (2 13) 

y€p yep 

Comparing equations (2 10) and (2 13) we can see that 


S'{w) — S{w) if to, = 0 and 
S'{w) = —S{w) if to, = 1 
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Hence by complementing the input variable x, the new spectrum can be found 
from the original spectrum by changing the sign of the spectral coefficienrs having 
subscript 1 . this requires the negation of 2”~^ spectral copfhcients 

s.j — -’U 

'^Ijk ^ ^Zjk 


Note that sq, Sj, s.j remain unchanged 

3 Complementation of the function output 
Let S(w) be the spectrum of f(x) 
and S'(w) be the spectrum of /( r) 

(2 14) 

x =0 

In binary 1, to real —1 mapping and binary 0, to real 1 mapping we have f{x) = 
— /(x), substituting this m the equation (2 14) we have, 

x = 2”— 1 

S'i^)= E -/(x)(-l)<“"> (2 15) 

x—Q 

therefore S'(w) = —S{w) By negating the function output, the new spectrum 
is obtained by changing the sign of all coefficients This lequires negation of 2" 
spectral coefficients 


So —Sq 


*'i 


“•Sl 


Si —Si 


■Su n “•^12 


n 



u 


4 Translation property 

Let S(\v) be tke bpec‘:-.ni of r„_2 i. 13) 

and S'(wj be the spectrum of /\x„_i t„_2, -ti x,jl 

This property can be explained from the equation ( 25 - For the above given 

matrix g_, xq is replaced by xq F- Xi and X3 is replaced bj rj -• X2 

If Xt IS replaced by x, S i ^ j >,j G 1 to n 

Let < 6 > be spectrum coefficients having subscript j the spectrum of the new 
function is obtained by, deleting the subscript j from < h > and appending sub- 
script J in all the coefficients This requiies the interchange of 2”“^ pairs of 
coefficient values 


S, w Sij 
^ ^tjk 
Siki S.jW 


Note that coefficients so,Sj,Sjk, are unchanged 


5 Disjoint translation property 
Let S(w) be the spectrum of f(x) 

and S'(w) be the spectrum of f{x) x, From equation(2 8) 


5(u-) = x^/(x)(-i)S.^>“'^"^ 

x€p 

Now from the definition of WHT 

S'(u,’) = (/(x) x.)(-l)<“'"> (2 16) 

x =0 


writing the same way as for S(w) we have 

2"-l 

E< 

x=0 


S'{w) = +(-ir (2 V) 




In equation (2 17 ) x, = 0 in the first term and x, = 1 in the second In binary 
1, to real —1 and binary 0 , to real 1 transformation Ex-oring with binary 1 and 
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f(x) results negatiie of f(x) Making use of this property from equation *'2 17 1 ive 
have, 

■^€p xEp 

It can also be written as, 

S'(w) = (2 19) 

isp 

comparing equations f2 8) and ^2 19) we have 


^ (^n—l — 2 ^ ' — 1 ^n— 2 ^ ^o) 

Replacing f(x) by /( r ) — x, i € 1 to n results in the spectrum if in every subscript 
of the spectral coefficients, i is deleted if it is present and is appended if it is not 
This results m the inter change of 2"~^ spectral coefficients 


S, So 

S,J Sj 

^ijk ^ ^jk 


Note that all 2" coefficients aue involved in this operation 

2.3.2 Canonic classification 

In canonic classification we arrange zeroth order and first order coefficients in descend- 
ing order, they are then made positive, with sq being the highest magnitude coefficient 
[14] When we compare the spectra of many Boolean functions, spectral coefficients 
with identical magnitudes occur in many spectra, with changes in sign and position We 
map any Boolean function to its prototype Boolean function by reordering 2" spectral 
coefficients by following steps 

1 When maximum value coefficient lies in the primary or secondary coefficient set, 
generate the maximum value for sq using Disjoint translation property 
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n < 2 

Spectral coefficients | 

^0 

Si 

S, 

S.2 I 

1 

4 

0 

0 

0 ' 

f 

1 

2 

2 

2 

2 

-2 1 

.. i 


Table 2 1 Classification of Boolean functions for n < 2 

2 Generate the maximum value for all primary coefficients to b\ making use 
of the translation property as necessary 

3 Permute the maximum valued primary coefficients Si to to order them in 
descending order of magnitude by application of operation(l) (equation (25)) 

4 Render all pnmary coefficients So to positive by the application of operation! 3 ) 

followed by operation! 2) necessary 

The result of these operations is to reorder the spectral coefficient values into a positive 
canonic order, which represents the classification entry of the given binary function f(x) 
From the table (2 3) it can be seen that, all 2 ^* functions of n < 4 (number of variables) 
can be represented by eight canonic functions, and for n < 5, the 2’’ possible functions, 
will have 48 classification entries 

With all zero and first order coefficients made positive, higher order coeflficients may 
be negative For a valid spectrum the sum of spectral coefficients must always be equal 
to ±2" 


2.4 Reed-Muller expansion 

In the previous sections we discussed partitioning of the Boolean functions using Walsh- 
Hadamard transform In this section we discuss the representation of any Boolean 
function in Reed-Muller form, with appropriate basis [9] 

It is known that any Boolean function can be realized by using AND and OR gates 
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n<3 



Spectral 

coefficients 



1 

i 

So 


^2 

^ i 2 

s 


^21 

^’23 1 

1 

8 

0 

0 

0 

0 

0 

0 


2 

6 

2 

2 

-2 

2 

-2 

-2 

1 

2 1 

1 

3 

4 

4 

4 

-4 

0 

0 

0 

i 

0 ’ 
! 


Table 2 2 Classification of Boolean functions for n < 3 


n < 4 

Spectral coefficients 


s 

1 


s 

?2 

s 

3 

V 




^4 

s 

. 24 

s 

124 

s 

. 3.4 .. 

s 

1^4 . 


^I2’4 

i 

16 

0 

0 

0 

0 

0 

0 
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0 

0 


0 

0 

0 
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Table 2 3 Classification of Boolean functions for n < 4 
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If any function / can be represented in the form of 

/ = Pi P 2 + -P 3 + -Pi 2 20 ) 


or, 



f-- 

= Qi Q2 


C?i7i 

© >1) 

where P,(l < 

t < k) and < 

j < m) are arbitary functions such that P, 

Pj =0 

and Q, Qj = 

0 for all 1 and j i ^ 

J then f can be 

written in the form 



i = 

= Pi © Pi 

©Ps 

^Pk 

12 22i 

or 







/ = 

QxZQ2 

IQ 3 

Qm 

i2 23) 


Thus, any function / can be realised using EX-OR and AND gates or EX-XOR and 
OR gates 

Any Boolean function f{x) can be expressed in Reed-Muller form m three ways 
For example a three variable Boolean function /(ri, J 2 ^ 3 ) can be represented as, 

1 


f{Ti.Xi.x-i} = ao~ai x[-^a 2 x\^az x'^^a^ x'^^a^ x[ x\ r[ x'^ 


(2 24) 


This expansion is called complement free iing sum expansion, when all x[ are 
equal to x,(see Definition of x[) 

2 This can also be can be expanded as 

/(ri,X2,r3) = {ho + 0) -9 {bi + x^) -r (62 + Xj) -r (hs + x[ + x'2) >t' (^-i + Cj)-r 

(65 + Xj + X 3 ) -5 {be + Xj + X 3 ) ‘F (fer + Pi + Pi + P-i) (2 25) 

3 Similarly, a two variable function 


/(xi,X2,X3) = Co-RCi Xi 4 )C 2 Xi-FlCj X2'&C4 Xi X2'& 
C5 Xi X2 © C6 X2 © C7 Xi • X2 © 0 $ A A© 
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C23 ^1 -^2 X 3 ~C 24 ^2 X3 C25 r> X3 C26 “i 72 73 ( 2 26 ) 

Any Boolean function can also be represented in Logical equivalent canonic foim 
in three forms, each form being dual of the corresponding RM lepresentation 

1 

/(xi.r2,X3) = (go + 0) : (ai+ ri) : (a2-rX2) : f'l,-- ri -x^} Z r^jZ 

(a, + xi + r3) G (oe + -ti + -^ 3 ) J («- + ^i i- ^2 + X 3 ) (2 27) 

2 

/(xi,X 2 ,X 3 ) = bo'Zbi Xi0&2 X 2363 Xi X2Zb4 X3L65 Xi XiZbe X2 xsZbj xi X2 fa 

(2 28 ) 

3 

/(xi, X 2 . ra) = (co + 1) I (ci + ii) I' i<^2 + xi) G (c 3 + X 2 ) G (C4 + Xi + X 2 ) ^ 

(C5 + xi + X2) 3 (ce + X2) G (ct + Cl + X2) G (cs + Xi + C2)G' 

[Cg + X3) 2 (Cio + Xi +X3) I (Cii i-Ti + X3) 2 (Cl 2 + -^^2 + ^3} G (Ci3 + Xi + 1-2 + -^3) _ 

(ci4 + xi + X2 + X3) 2 (ci 5 i" X2 + X3) 7 ( cit, + xi + X2 + X3 )G 

(ci 7 + Xi +X 2 + X 3 ) 2 (Ci 8 + X 3 ) 2 lCl9 + Xi + X 3 ) I (C 20 + Xi + Jj) 2 
(C 21 + X 2 + X 3 ) o (C22 + Xi 4- X 2 + Ta) G {C23 i- A + X 2 + Ta) “ 

(C24 + X2 + X3) G (C 25 + Xi + X2 + X}) G (C 26 + Xi + J2 + Xa) (2 29 ) 
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where a,. &j, c, are 1 or 0 and are different for the two representations 
Any Boolean function / can be represented b\ a binary vec^'or 

/ = {o-o '>-1 ) 

Oo, fli <22 1 being the coefficients of each term in equation f 2 24 1 The function 

/ can be obtained from binary vector and basis functions m the free ring sum expansion 
by using the relation 

F = ^A (2 30 ) 

where F is a coloumn vector having function output values, A is a binary coloumn 
vector with elements qq, <21,02, ,a2n_i and ^ is a 2" x 2" matrix which is shown 
below for n = 3 each coloumn lepresenting the basis functions. 1, Xi.ri -^Ti I2 J-s 
^3,^2 22 23, in the same order 

1 0 0 0 0 0 0 0 

1 1 0 0 0 0 0 0 

1 0 1 0 0 0 0 0 

1 1 1 1 0 0 0 0 

M.= 

~ 1 0 0 0 1 0 0 0 
110 0 110 0 
10 10 10 10 
11111111 
The inverse of the matrix ^ is the matrix itself Pre- multiplying equation (2 30 ) 
with we thus have, A = ^F The matnx ^ can be decomposed and is equal to 

For n = 3 , 

1 0 0 0 0 0 0 0 

0 0 1 0 0 0 0 0 

0 0 0 0 1 0 0 0 

0 0 0 0 0 0 1 0 

5 = 

1 1 0 0 0 0 0 0 

0 0 1 1 0 0 0 0 

0 0 0 0 1 1 0 0 

0 0 0 0 0 0 1 1 




For an n variable Boolean function f{x} X' = < is called polarity 

vector of /(r) It can be seen tnat fhe polanty vector .Y' ran take 2 " values Our 
problem is to determine the appropriate polarities of -Y' such that the binary vector 
(ao <21,02. 02'>-i) oif(v) contains mmimumnumber of elements haMng\ aides either 

only ones or only zeros For a function which is of the form equation t 2 20 ,i we hnd 
polarity functions for each P,, wheie polarity functions are aoi f j ad/), oi^-il/) 
and we substitute these back m the same equation \Ye substitute different polarity 
vectors in the resultant equation to get minimum number of EX-OR gates or maximum 
number of EX-OR gates 



Chapter 3 


Implementation details 


In this chapter we discuss the implementation details, using the methods described in 
the previous chapter We considered the images having 256 intensity levels, however 
it can be extended to the images having any number of intensity let els Consider an 
image, where each pixel is represented by k-bits By selecting a single bit from the same 
position in the binary representation of each pixel, k-binary images called bit planes 
can be generated [6] For an image having 256 intensity levels we thus have 8 bit planes 
We have implemented two types of compression schemes Lossless compression which 
results m retrieval of exact copy of the original image This scheme has also been tested 
for text files Lossy compression which results m retrieval of approximate copy of the 
original image 

3.1 Lossless compression 

In this section we discuss the Lossless compression scheme The flow chart that has 
been followed is shown in figure 3 1 Our compression scheme basically consists of the 
following steps 

• Pre processing 

• Function generation 

• Coding 
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Original Image 



Compressed Image 


Original Image 



Compressed Image 


Figure 3 1 Compression scheme 
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X’ = (C+B)/2 
Error = X-X’ 


Figure 3 2 Linear prediction 

3.1.1 Pre Processing 

The original image file is preprocessed to get more compression Two methods for 
preprocessing the images have been adopted in our problem 

1 Indexing method 

It IS possible that not all the 256 intensity levels are present in a given image The 
actual intensity levels appearing in the original image are arranged continuously 
by assigning successive integer values from 'O’ onwards in the pre-processed image 
The presence of a particular intensity level is indicated by a 256 bit overhead in 
the global header, to facilitate decompression 

2 Linear prediction 

In the Linear prediction scheme, the value of the current pixel is predicted by 
averaging the two pixels, one which is above the current pixel and the other to 
the left An error file is generated by subtracting the predicted value from the 
actual value as shown in figure 3 2 The first row and the first coloumn of the 
error file are same as the first row and first coloumn of the original image This 
error file is recoded by adding the absolute value of the maximum negative error, 
if present, to the each error value so that only positive values are present in 
the error file The global header also contains an extra 8 bits, to indicate the 
magnitude of this maximum negative error 
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Aftei preprocessing the image file, these intensity levels in the pre-processed image 
are replaced by their equivalent gray codes So that adjacent values are 1 to 

adjacent codes having fewer transitions between 0 s and Ism *he bit planes Grav 
coding also increases the probability of all l(black) and all Or.thitei blorics in bit 
planes [6] 

3.1.2 Function generation 

The preprocessed image file is now split up into bit planes These bit planes can be 
8 or 9 in number in case of linear predictive preprocessing If the magnitude of the 
error values in the error file is greater than 256, then 9 bit planes are used In the 
case of indexing method, the number of bit planes depends on the number ot different 
intensity values present in the original image The global header also contains four bits 
to indicate the number of bit planes The bit planes are divided into fixed windows 
of n X m sizes, where n indicates the number of rows in the window and m indicates 
the number of coloumns Each window is treated as a Boolean function of log 2 (n x m ) 
variables treating the values of n x m binary pixels as its output To indicate the 
number of variables involved in the Boolean function an extra four bits are used in the 
global header Figure 3 3 shows the conversion of a windo\\ with 4x8 binary pixels 
into a 5 variable Boolean function, where black represents a 1 and white repiesents a 0 

3.1.3 Coding of the bit planes 

Each bit plane is divided into windows of sizes n x m pixels The data in each window^ is 
classified into three types, all black pixels, all white pixels and mixed type( combination 
of both black and white) pixels Windows with all white pixels are lepresented as 00 
and all black pixels as 11 

For a mixed type of window, we try to compress the window by using Reed-Miiller 
method of minimising and coding, and in the other technique by mapping this window 
into its proto type Boolean function by Walsh- Hadamard transform, and coding the 
operations required for it For a certain windows compression may not be achieved So 
the windows which are compressed are represented by a header 01 and the coded bits, 
which are less than number of original bits for that window The windows for which 
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compression is not aciueved are represented by a header 10 and the orisinai n ' rn bits 

Coding of the mixed type window 

Coding for the mixed type window can be done in two ways Walsh-Hndarr'ard frcn^- 
form method and Reed-Muller expavsion 

1 Walsh Hadamard transform 

Each mixed type window is comerted into its prototype Boolean function by 
using log 2 {n X m) + 2 sets of operations for a n x m window as described in 
the previous chapter The position of the prototype Boolean function in the 
corresponding classification table is represented using 3 or 6 bits, depending on 
the window size The first log 2 {n x m) + 1 set of operations can be represented 
from 0 to n X m, requiring log 2 {n x m) bits The last operation is represented 
from 0 to 2nm and requires log 2 {n x m) + 1 bits These operations are coded by 
adaptive block coding [10], treating each operation set as a block If the number 
of coded bits including the coded number of the prototype Boolean function are 
more than n x m bits then it is coded by a header 10 and proceeded by the 
original bits 

For the window which is shown in the function generation diagram(figure 3 3) 
The window is first converted into a Boolean function f{xn-i,Xn- 2 i > ^o)i it’s 
Walsh- Hadamard spectrum s(w) is found, and is shown below 
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The spectrum is then converted into a positive canonic Boolean function as de- 
scnbed m the previous chapter, using the following steps 
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Replace input variable vi by oii to make S2 positive The new spectrum resulting 
IS shown below 
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To interchange S4 and S3, T2 and ^3 are in*''’rch?nged The resulting spectrum 
after this operation is shown below 
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To make S3, S4 and S5 positive, we replace input variables X2, X3 and r4 by r2, x-i 
and J4 lespectively The resultant spectrum is a positive canonic function 
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Dummy operation 

i 

t 

0008 00 60 0 
1 

f 

0008 00 60 0 



00 08 00 60 0 



0 8 6 0 O-e— Neglecting 

this bit 


10 I 00 0 1011 111010101lj 0100 Oj 111100! 


Coded bits 

Figure 3 5 Example using WHT 

To code the operation sets required, to make the window a prototype Boolean 
function We put a 0 if there is no operation required, in the respective operation 
set position Therefore for above example we get the operation set block as 
0 0 0 8 0 0 60 

where the first block is for so and so on up to last one, and the last block having 
number 60, is the decimal representation of 111100 

X4 X3 X2 Xi Co f(x) 

11110 0 

which indicates whether respective variables are complemented oi not. 1 indicat- 
ing complementation and 0 indicate uncomplement The coding of these opera- 
tions IS shown in figure 3 5- By treating one more dummy operation with zero 
value and not taking the code corresponding to that operation, the output bits 
of the window are 01 000101 1110101011 01000 111100 where first two bits 01 
mdicate that it is a compressed window and six bits 000101 indicate the position 
of the prototype Boolean function in the classification table for n < 5. 


2 Reed-Muller expansion 
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Waish Hadamard transform : 
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Operation 
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-sed the prototype 

window function 

Figure 3 6 Window format for WHT 

By choosing appropriate basis, each -window is represented in the Reed-Muller 
form In this representation we try to minimise the number of coefficients having 
values either only ones or only zeros as explained in the pievious chapter Figure 
3 7 shows the general format of window in encoded form The first two bits 
are used to repiesent the window type i e , all black or all white or compressed 
or uncompressed window The next bit is used to indicate whether, the coded 
coefficients are ones or zeros Depending on the window size the upper limit 
Cmaa:, the uumbcr of coefficients is calculated Beyond this limit this technique 
leads data expansion, requiring log 2 {^^^) - 1 bits to represent the number of 
coefficients where k = log 2 {n x m) Coding of the position of these coefficients 
is done by using p x (log^ (n x m)) number of bits, a binary 1 m the ith position 
indicates the presence of the variable z', where x[ may be z, or x, and binary 0 
indicates the absence of the variable 
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Reed Muller representation 
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Figure 3 7 Window format and example using RMT 

For the same example given in figure 3 3 If this Boolean function is expanded m 
uncomplement free ring form, we get 

/(x 4 ,X 3 ,a: 2 ,xi,Xo) = xo 0 xo xi9xo X30xo xi X 2 r30ro X 3 X40xo Xi 13 c^—xo 

^2 ^3 ^4 ^0 *^1 ^2 ^3 ^4 

having 8 coefidcients with value 1 If we use polarity \ector x' = (X4 X3, T2 ri fo ) 
then 

/(j) = ro Ti0XoXi X3 0Xo Xi T 2 1 : 3 x 4 

giving only three coefficients having value 1 The coded bits of this wundow are 
01 1 10110 011 00011 01011 11111 where the first two bits 01 indicate that it is 
a compressed window, the next bit 1 indicates that coefficients are Fs , 10110 
indicates whether the correesponding literals x. are complemented or not, with 
1 indicating complemented and 0 indicating uncomplemented form, the three 
bits after these bits axe used to indicate the number of coefficients having value 
1, and the remaining blocks of 5 bits are used to indicate the position of these 

coefficients 

It IS possible many windows m an image bit plane can be compressed by the previous 
or by virtue of the fact that they are all black or all white windows Several 


(?) Indexing method 
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Figure 3 8 Global Header 

other windows may not yield any compression, leading to a net expansion for an entire 
bit plane This usually happens for the bit planes obtained for two or three least 
significant bits of most images because they ha\e random chaiactenstics compared to 
the higher bit planes In such a case the entire bit plane is stored without carrying out 
any operations on it in the compressed file A one bit global header is associated with 
each bit plane to indicate whether the status of a bit plane 

To indicate the number of bit planes four bits are usetl in the global header In the 
case of indexing method of preprocessing, global header contains a 256 bit over head to 
represent the presence of intensity levels in the original image We applied this lossless 
compression scheme to the text files and format of the global hea<ier corresponding to 
file compression is shown in figure 3 8 
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Compressed Image 



Original image 


Figure 3 9 Lossless decompression Scheme 

3.2 Lossless decompression 

The Lossless decompression procedure consists of three steps, as shown in figure 3 9 

• Window recovery 

• Bit plane recovery 

• Image recovery 

Window recovery (decoding) consists of locating a block of data corresponding to 
a window in the compressed image and reconstructing the original bits of this window 
The two bits in the coding scheme indicate whether the window is compressed or 
uncompressed or all white or all black If the window is not in the compressed format 
then the recovery of this window is straight forward 

For a compressed window, in case of Reed-Muller representation, the bit after these 
two bits indicate the coded coefficients are zeros or ones Depending on the value of the 
Cmax, we determine the number coefficients having zero values or one values and their 
position From these coefficients and through the appropriate basis function, which is 
contained m the compressed block we reconstruct the original Boolean function By re 
mapping this Boolean function we get the original window 
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Compressed window 



Figure 3 10 Decompression of a window 

For the example which is discussed in the previous section the coded bits in case of 
Reed-Muller lepresentation are 01 1 10110 011 00011 01011 11111 where 01 indicates 
it IS compressed window, 1 indicates the coefficients are I’s 10110 is a polarity vector 
i' 0 indicates uncomplemented and 1 indicates complemented literal x,, 011 indicates 3 
coefficients are 1, and the positions of these coefficients are 3, 11. 31 therefore gj, ou G31 
are I’s, using these coefficients and the polanty function, the reconstructed function 

f{x) = Xo Ti'^XqXi X 3 -$Xo Xi J2 r}X4 

from this function we find the binary pixel values, by remapping into a window 

In the case of Walsh- Hadamard transform, number of the prototype Boolean func- 
tion IS determined and the operation set is retrieved from coded bits For the above 
example the coded bits are 01 000101 1110101011 01010 111100 where 01 indicates it 
IS a compressed window and 000101 indicates the position of the prototype Boolean 
function in the table By decoding these coded bits we get the operation set as 0 0 0 
8 0 0 60 Taking the prototype function from the table and doing operations in the re- 
verse order we get the original spectrum Complementing the input variables X4, xj, x^, 
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interchanging the input variables ^2 and X3 and compin' -.‘.nr xo we ha^.e ^he orig- 
inal spectium By taking the inverse transform we get original Boolean function Th^ 
spectrum of prototype function is 
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After performing the above operation we get the following spectrum which is spectrum 
of original Boolean function of a window as shown below’ 
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By taking the inverse transform of this we can reconstruct the original window 

Bit plane recovery consists of reconstructing an entire bit plane from the lecovered 
windows of this bit plane If the bit plane has not been compiessed which is indicated 
in the global header, the recovery is straight forward 

Image recovery consists of combining the individual bit planes of the image Image 
recovery first yields the preprocessed image file. In the case of linear prediction first 
error file is obtained, from which original gray values are obtained by first subtracting 
the maximum negative error and then using reverse prediction In the case of indexing 
method, from the preprocessed image file we get the original image file by substituting 



37 


Image 



k 


Lossy 

compression 


I 


Lossy 

decompression 


Figure 3 11 Lossy compression and decompression scheme 


the original pixel values which are determined from the 256 bit overhead in the global 
header 


3.3 Lossy compression 

In this section we discuss the Lossy compression scheme, which result in ietne\al of 
approximate copy of the original image The flow chart for this scheme is shown m 
figure 3 11 The lossy compression scheme consists of the following two steps 

• Reducing the number of bit planes from eight to five 

• Lossless compression scheme 

To reduce the number of bit planes, we first reduce the number of gray levels to 32 or 
less in the image Here we employed the fact that human eye can not detect very small 
changes in gray values and have substituted a single gray value for a adjacent gray level 

values 
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We divide the range from 0 to 255 into 32 intervals 0-7. S-15 16-23 24S-255 

each interval consists of 8 gray \alues Each gray \alne is coiin^ed and for 

each interval we find glnew by using the center of mass formula 


9^ 


new 


L^t—Sk J * 


•3 


where /, is frequency of occurance of I’th gray level in the image and i roiresponds 
to gray level value These new gl„ew gray le\els are obtained for each larerval and is 
substituted for the gray values falling into this interval If the value obtained above is 
a fraction then it is rounded Thus for each interval we find a gray value glneu. which 
IS biased towards those gray le\els whose frequency of occurance is more and thus help • 
to reduce the mean square error value The reduced image will have almost 32 gray 
levels and each of these values denote the center of mass of the mteival in which the 
gray level falls The five MSB’s of each recoded gray value represerys the interval and 
the 3 LSB’s denote the offset from start of the interval to it s the center of the mass 
We can maintain these offsets in an array of 32 x 3 bits and recode the interval by 5 bit 
gray code Thus the entire recoded image now consists of 5 bit planes and a 32 x 3 bit 
over head for denoting the offsets are included m the global header This is the only 
step where we incur loss in the image Qualitatively one can not visually distinguish 
between the original image and the recoded image having onl> 32 gray levels 

The global header m the lossy compression consists of 5 or 6 bits to denote whether 
the bit plane is compressed or not and a 32 x 3 bit over head to represent the offsets 
with respect to the center of mass for the 32 levels There will be 5 or 6 bit encoded 
bit planes and the same window formats in the case of lossless compression 


3.4 Lossy decompression 

Lossy decompression consists of the lossless decompression technique as <lescribed pre- 
viously and followed by retrieving of center of mass values from the recode<l gray levels 
and the offsets with reference to the center of mass of that level 



Chapter 4 


Results 


Compression and decompression algorithms have been implemented in C' on HP 
9000/850 and tested on standard gray scale images girl, baboon, boat each of size 
256 X 256 pixels and 8 bits per pixel(256 intensity levels) The tables give the results of 
the compression experiments as well as a comparision with block coding and with our 
schemes The results have been obtained for windows of sizes 4x4 and 4 x 8 for each 
bit plane The tables show compression ratio, compression time, decompression time 
for both the sizes The compression time for our compression scheme was much higher 
than that of block coding and decompression time is comparable to that of block cod- 
ing However compression ratio is higher than that of block coding Our compression 
scheme and decompression scheme has been tested on some text files and the results are 
compared to the pack and compress commands available in the HP 9000/850 The re- 
sults shows that we got less compression than that of the compression commands gi\en 
above The decompiessed images for lossy compression were visually indistinguishable 
from the original images Mean square error in the decompressed lossy images is also 
shown in the tables Compression times reported here include the preprocessing time 
as well Decompression time is very less as it is very easy to generate the Boolean 
function from the coefficients and the basis in the case of Reed-Muller representation 
and for Walsh-Hadamard transform from the index of the prototype Boolean function 
and operations required for it, therefore it is comparable to block coding 
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{ndexing method 
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Linear prediction 
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Table 4.1: Loss-less compression for n=5 



Without pre-processing 
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indexing method 
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Linear prediction 
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Table 4.3: Loss-less compression for n=4 







Without pre-processing 
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Linear prediction 
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Table 4.4: Lossy compression for n=4 
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Figure 4.1: Original image of Lenna 



Figure 4.2: Lossy reconstructed image of Lenna 
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Figure 4.3: Original image of Baboon 



Figure 4.4: Lossy reconstructed image of Baboon 





FigtK^.6: Lossy reconstructed image ot boat 



Chapter 5 


Conclusions and Future work 


A novel lossless data compression technique for monochrome images has been presented 
Performance of our technique m terms of the compression ratio is better than block 
coding Reed-Muller way of compression is better than that of Walsh-Hadamard way 
of compression in terms of compression ratio and compression time Compression rime 
is rather high, it is due to the reading of prototype function from a file for every 
window, and m the case of Reed-Muller representation it is due to the time taken to 
generate the appropriate basis (polarity vector) for each uindow Decompression time 
is comparable to that of block coding For a window of lesser sizes, compression time 
is lesser than that of bigger windows and the compression ratio is higher We hate 
applied our technique to the text files but the compression ratio is lesser than that 
of already existing techniques It is due to the fact that other schemes employ global 
information to compress the file, where as our scheme employs local information to 
compress it We tried to apply our compression scheme to already compressed files bt 
using pack or compress commands We got very low compression for a file having veiy 
few characters, but for files of bigger size we could not get any compression 

Possible direction for the future work are. using a quad tree approach windows of 
different sizes can be generated this can improve the compression ratio Minimum two 
level Reed-Muller representation is not most compact representation for all switching 
function Reed -Muller hke canonic forms for multi valued functions with appropriate 
basis functions lead to much more compact representation Higher compressions < an be 
achieved by partitioning the multi valued functions using Walsh-Hadamard transform 
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and using the operations required for it The bc'^t compression scheme v;ill one *n 
which the different possible way of compies^ion methods are jsed r^nci ^ne ootinial one 
IS chosen for each block of the bit plane This can inmiot p the rornpre^-ion 

ratio at the cost of additional computation 
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